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Description 

BoBharound f » the Invention 
1. Field of tho Invention 

roOOl] -Rie invention relates generally to image en- 
hancement techniques, and more specifically to rea> 
time image enhancement methods wh.ch are performed 
on textual and/or color photographic images. 



ment algorithms to each color 

and blue) individually, as descnbed m 

ihe resulting image may not be enhanced opJn»*£- 

aoe distortion will result if the red. green, an d Uu»m* 
b ponents are not properly recomblned after the n^o- 
chrome imace enhancement algorithms are applrt. 
Moreover. image distortion will also result .1 the red, 
green, and blue components are processed ndepana- 
intly, without considering correlation among the com- 
to ponents. 



Description of the Prior Art 

fOOOfcl Image enhancement is a process by which ac- 
quired image data values are manipulated. Such manip- 
ulation is typically directed to improving appease 
of the data as perceived by humans, and/or to render 
the data more suitable tor machine analysis or the im- 
age Image enhancement processes are distlngu.sha- 
ble from image restoration processes in that one elec- 
tive of restoration processes is to improve the fidelity 
and/or accuracy of a reproduced image with respect to 
the original image, whereas enhancement processes 
place greater emphasis on human visual perception 
and/or the suitability of the processed imago for compu- 
ter analysis. . ^ 
[0003] Various image enhancement processes have 
been developed lor improving the perceived clar.ty. m- 
telligtollity, and/or quality ot images. These image en- 
hancement processes attempt to render Images more 
pleasing to human eyes, irrespective of whether or not 
these images are accurately reproduced. Oftentimes, a 
distorted image is more pleasing to the human eye than 
a perfectly reproduced copy of the original image. For 
example, if overshoot or undershoot is incorporated tnto 
the edges ol an image, the resulting image is typically 
perceivedas being more pleasing than an image without 
such undershoot or overshoot 
[0004] Many prior art image enhancement processes 
have focused on the improvement of gray-level images, 
* but a direct extension of these processes into the color 
domain results In degraded or suboptimal images. At the 
present time, there is a notable lackot image enhance- 
ment techniques which are optimized tor use in conjunc- 
tion with color images. The widespread distribution of 
color images, the growing popularity of multimedia ap- 
plications, the current proliferation of personal comput- 
ing devices, and ihe development of high-definition tel- 
evision systems all serve to increase the demand for im- 
proved color image enhancement methods. Such image 
enhancement methods should be optimized for use in 
conjunction with color images, and should not merely 
constitute the roapplication of a gray-level method to the 
color domain. Moreover, such image enhancement 
methods should operate in realtime using existing hard- 
ware platforms. 

[000S] Although it is possible to enhance a color im- 
age by applying existing monochrome image enhance 



c.^ifrtflr Y af the Invention 

100061 improved image enhancement methods are 
rs disclosed which may be performedon conventional vid- 
eo processing systems. These methods operate m real 
time to improvo the appearance of Images as perceived 
by the human eye, and/or to render these Images more 
suitable tor computer analysis, A preferred embodiment 
20 enhances color Images without degrading the color h- 
delity of the image. 

[0007] According to the preferred embodiment, a 
color image is represented by a plurality of pixels tn HSV 
thus, saturation, and intensity) color space. The color 
2S image exhibits a finite range of intensity values and a 
finite range of saturation values. The image is enhanced 
by applying a first transformation 1 unction tothe intensity 
components of the image and a second translation 
function tothe saturation components of the imagers 
30 first transformation function transforms the range of in- 
tensity values in the image to correspond to the errt.m 
dynamic range of intensity values available m the video 
processing system. The second transformation function 
transforms the range of saturation values In the image 
3s to correspond to the entire dynamic range of saturation 
values available in the video processing system. The 
transformation functions provide an enhanced image 
having fully optimized intensity and saturation compo- 
nents. The enhanced image is provided by optimally &\- 
40 locating the available dynamic range ot intensity and 
saturation values of the video processing system. Sat- 
uration and intensity are enhanced to their extremes 
without the introduction oi color distortion. 



46 Brief Description of th e Drawings 

[0008] The file ot this patent contains at least one 
drawing executed in color. Copies of this patent with 
color drawing(s) will be provided by the Patent and 
so Trademark Office upon request and payment of the nec- 
essary fee. 

FIG. 1 is a graphical representation ol atransforma- 
tlon function lor mapping the intensity components 
j- 55 of a color image; 

FIG. 2 illustrates intensity components tor an exem- 
plary color image comprised of a plurality of pixels; 
FIG. 3 is a histogram showing the.relative distribu- 
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tion of intensity components for the image of FIG 2; 
Fl G 4 is a color pictorial rep resantation showmg the 
application of the color image enhancement proce- 
dures disclosed herein to an illustrative image: 
FIG 5 is a pictorial representation showing the ap- 
plication of the gray-scale image enhancement pro- 
cedures disclosed herein to an illustrative optically- 
scanned document; 

FIG. 6 is a graphical representation of a transf orma- 
tion function lor mapping the Cr chroma component 
of a color image; and 

HG 7 is a graphical representation of a transforma- 
tion function tor mapping the Cb chroma component 
of a color image. 

Detailed peAcriptlon of Preferred Embodiments 

[0009] me image enhancement methods disclosed 
herein are directed to improving the appearance of im- 
ages as parceled by the human eye, and/or to render 
these images more suitable for computer analysis- A 
first preferred embodiment enhances color images with- 
out degrading image fidelity, and a second preferred 
embodiment enhances scanned gray-level document 
images by decreasing tho blurring of the image and by 
increasing the contrast between light and dark regions 
of the image, Presently-existing video processing sys- 
tems can perform the image enhancement methods dis- 
closed herein in real time. Suitable video processing 
systems may include, for example, a microprocessor 
and a video memory, both of which are present in con- 
ventional video telephones such as the AT&T Picasso 
Still-Image Phone. The AT&T Picasso Still Image Phone 
is disclosed in copending U. S. Patent application Serial 
Number 08/202608. 

[0010] With respect to the first embodiment, a color 
image can be enhanced much more effectively in HSV 
(hue. saturation, and intensity) color space than in HG B 
{red, green, and blue) color space. In HSV color space, 
the color information (hue) is isolated and removed from 
the remaining image components (saturation and inten- 
sity), in this manner, saturation and intensity may be en- 
hanced to the maximum extent possible, without intro- 
ducing distortion into the color (hue) component Any 
color image may be represented by a plurality of pixels 
in HSV (hue, saturation, and intensity) color space. For 
example well-known methods may be used to convert 
a conventional NTSC, SECAM. RGB, or PAL video sig- 
nal into HSV color space. In some cases, this conver- 
sion process is implemented by performing relatively 
simple computations, but in other cases, nonlinear 
mathematical operations are required. Such nonlinear 
operations are computationally expensive. Therefore, 
tho immediately following description win consider im- 
age enhancement in the context of HSV color space, 
after which image enhancement in other color spaces 
will be discussed. 

[0011] Every color image exhibits a finite range of in- 



tensity values and a finite range of saturation values. 
Moreover, in HSV space, these intensity and saturate 
values are specified as individual components of the im- 
age Conventional video processing systems are 
5 equipped to process a finite range of intensity values, 
as well as a finite range of saturation values. However, 
the range of intensity values present in the image is not 
necessarily identical to the total dynamic range of inten- 
sity values which conventional video processing sys- 
io terns are equipped to process. Similarly, the range of 
saturation values present in the image is notnecessanly 
identical to the total dynamic range of saturation values 
which conventional video processing systems are 
equipped to process. 
is [0012] Typically, the available dynamic range of the 
video processing system is much wider than the range 
of intensity and saturation values included in a color im- 
age Therefore, unless image enhancement methods 
are applied to the image, only a portion of the available 
20 dynamic range of me video processing system will be 
utilized. If the image is underexposed, the intensity val- 
ues of the image are clustered towards one extreme of 
the available dynamic range of the video processing 
system, and remaining portion© ol the dynamic range 
2$ are relatively underutilized. If the image is overexposed, 
the intensity values of the image are clustered towards 
another extreme of the available dynamic range, and re- 
maining portions of the dynamic range are likewise un- 
derutilized. 

so (001 3] A first transformation function is applied to the 
intensity values of the image to optimally utilize the avail- 
able intensity value dynamic ran ge of the video process- 
ing system. A second transformation function is applied 
to the saturation values of the Image to optimally utilize 
as the available saturation value dynamic range of the vid- 
eo processing system. The hue values of the original 
image are not changed. The purpose of the first trans- 
formation function is to allocate the dynamic range of 
intensity values provided by the video processing sys- 
40 tern to optimally correspond to the dynamic range of in- 
tensity values included in the original color image. Tne 
second transformation function allocates the dynamic 
range of saturation values provided by the video 
processing system to optimally correspond to the dy- 
45 namic range of saturation values included in the original 
color image. 

[0014] The first transformation function is a piece wise 
linear mapping function in two dimensions having three 
substantially linear regions defined by lour intensity val- 
so U e points- A first dimension represents intensity input 
values (I.e., intensity values included in an image to be 
processed), and a second dimension represents inten- 
sity output values (i.e., optimized intensity valuos for tho 
enhanced image). A first intensity value point is repre- 
ss sented by the minimum intensity value in a given image, 
a second intensity value point is represented by the 
maximum intensity value in this image, and the third and 
fourth Intensity value points are selected to be between 
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the first and second intensity value points. Selection of 
value* for the third and fourth intensrty value 
Sints are detained by the extent to wh.ch a given .rr> 
age is under- or over-exposed- 
[0015] Refer now to FIG. 1, which is a graphical rep- 
mentation of an illustrative transformation function for 
mapping the intensity components of a color image. Im- 
age enhancement is performed by transforming the in- 
tensity values of the image using a piece wise linear 
mapping function 102 lor the intensity component The 
piece wise linear mapping function 102 consists of three 
iine segments 104. 106. 103. Line segment 104 .e de- 
fined by points vmto and vtower, line segment 106 »s 
defined by points vlower and vupper, and line segment 
108 is defined by points vuppcr and v/nax vmm and 
vmax denote the minimum and maximum intensity lev- 
els, respectively, in the original image, v/owerand vup* 
per determine the dynamic range allocation tor lower, 
intermediate, and higher ranges of intensity levels 
[001 6] The range of intensity values in the ongmal im- 
age specifies values for vmin and vmax The values of 
v/owerend vupporwe then selected to optimize image 
enhancement for a given image, baaed upon the char- 
acteristics of the image to be enhanced. For example, 
if the original (mage to be enhanced is under-exposed, 
vtower and vuppor should be selected with a view to- 
wards enhancing lower intensity levels. Therefore, a 
greater proportion of the available dynamic range of the 
video processing system should be allocated to the low- 
er intensity range. Such an allocation is accomplished 
by selecting vtower to be relatively close to wn/n, and 
by selecting vupperto be relatively far away from vroax 
In this manner, high intensity levels are compressed, 
and low intensity levels are expanded. 
[00171 K *ne original Image is over-exposed, vvpper 
should be relatively close to vma* and vlowcr should 
be relatively far away from vm/n. In this manner, lower 
intensity levels are compressed, and high intensity lev- 
els are expanded. A greater portion of the video 
processing system's dynamic range win then be allocat- 
ed to higher intensity levels. 

(0018] FIG. 1 includes an identity mapping function 
103 which wilt be discussed hereinafter in connection 
with the second transformation function and image sat- 
uration values. 

[0019] With reference to FIG. 2 and 3, specific calcu- 
lations for vupperand Woivermay be performed by de- 
veloping an intensity value histogram for the image to 
be enhanced. Such an histogram divides the range of 
intensity values present In a given image, I.e., the range 
from vm/n and vmax, into a plurality of sub-ranges. For 
each of the plurality of sub-ranges, the number of pixels 
in the image having intensity values in this sub-rango is 
determined. The first moment of the histogram may ba 
conceptualized as the "center of gravity" of the histo- 
gram. The "center of gravity, i.e. the first moment, may 
be calculated by using the formula 




tml 

,v 



where I, represents a specific intensity level, h-, is the 
10 number of pixels having intensity level l v and N is the 
total number of intensity levels (sub-ranges). For exam- 
pie, intensity level 301 (FIG. 3) may be conceptualized 
as representing intensity level one (I,), intensity level 
303 may be conceptualized as representing intensity 
is level two <i 2 ), and intensity level 319 may be concepts 
alized as representing intensity level ten (l 10 ). in this ex- 
ample, there are ten intensity levels (I.e.. ten sub-rang- 
es), so N Is equal to 10. 

[0020] FIG. 2 illustrates intensity components for an 
20 exemplary color image 207 comprised of a plurality ol 
pixels 201. 203. and 205. Each pixel 201, 203, 205 IS 
associated with a specific value representing the mien- 
sity component for that pixel. For example, pixel 201 is 
white, which may be defined as representing a relatrvery 
is low value of intensity. In this manner, pixel 205, in black, 
represents a relatively high value of intensity, and pixel 
203 in diagonal cross-hatching, represents an Interme- 
diate value of intensity with respect to pixels 201 and 

205. . . 

30 [0021 J FIG. 3 is an intensity value histogram showing 
the relative distribution of Intensity components for the 
color image 207 of FIG. 2. The intensity value histogram 
shows the number of pixels in a given image that have 
specific intensity values. They-axis. labelled in 'number 
ss of occurrences", is in units of pixels, and the X-axis rep- 
resents intensity levels. In the example of FIGs. 2 and 
3, ten different intensity values are employed to repre- 
sent the pixel Intensity values of the image. With refer- 
ence to FIG. 3. the lowest intensity value is represented 
40 by intensity value 301 (shown in white), intermediate in- 
tensity values are represented by intensity values 303, 
305. 307, 309, 311, 31 3, 315, and 317, and the highest 
intensity value is represented by intensity value 319 
(shown in black). From the intensity value histogram of 
4$ FIG. 3, it is observed that the color image 207 includes 
45 pixels having intensity value 301 , 14 pixels having 
Intensity value 303. 22 pixels having intensity value 305, 
etc. The firsl moment of the intensity histogram is the 
intensity value including the greatest number of pixels 
so which, in the present example, is Intensity value 301 
having a total of 48 pixels. 

[0022] The first moment of the intensity value histo- 
gram provides an indication as to the relative over- or 
under-exposure of a given image. The first momant is 
ss closer to vm/n (FIG- 1 ) for an underexposed image, and 
closer to vmaxfor an overexposed image. Based upon 
the first moment of the intensity value histogram (FIG. 
3), two intensity levels, vtowfrf and vuppar, are cateu- 
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lated such M as the first moment becomes increas- 
ingly closer to vm/n, w/pP*r increases and itar de- 
creases As the first moment becomes increasingly 
closer to vmax, WPP* decreases and W°w*r*ncreas- 

r0O23] Let the full dynamic range of the video process- 
ing system be given by [VMIN. VMAX|. where VMI N and 
VMAX correspond to the minimum and maximum inten- 
sity va iues capable of being represented inagiven video 
processing system. In the case where a vj*o 
ing system consists of a video display device, VMIN and 
VMAX are selected to correspond to the minimum and 
maximum intensity values capable of being displayed^ 
intensity values between vmftiand viewer are mapped 
linearly to the range [VMIN, VLOWER] , where VLOW- 
EH = VMIN + {( Mower - vmin)/3}. intensity values be- 
tween viower and vuppor are linearly mapped to the 
range of [VLOWER, VUPPER], where VUPPER 
VMAX - Hvmax - vvpperysy Intensity values in the 
range [vupper, vmax] are linearly mapped to the range . 
ryyppER VMAX]. Note that the denominators of the 
equations' for VUPPER and VLOWER include a value 
of 3 This value is shown for illustrative purposes. Values 
differing somewhat from 3 may be employed such as, 
lor example. 2.5 or 3.7. Moreover, a different value (i.e.. 
4 0) may be employed in the denominator of VUPPER, 
relative to the value employed in the denominator of 
VLOWER (i.e.. 2.3). 

[0024] THe mapping of the intensity values as de- 
scribed in the immediately preceding paragraphs per- 
mits proper allocation of the dynamic range of a given 
video processing system to the actual range of intensity 
values present in an image to be enhanced, 
[002S1 A second transformation function is used to 
transform the saturation components of the original Im- 
age Into saturation components for the enhanced im- 
age. This second transformation function is determined 
by applying a histogram stretching procedure to a satu- 
ration histogram representing the saturation compo- 
nents of the original image, A first saturation value point. 
smin, represents the minimum saturation value in the 
image, and a second saturation value point, smax, rep- 
resents the maximum saturation value in the image. 
[0026] An upper limit oi saturation, supper, is defined 
as that saturation level where the area under the satu- 
ration histogram from that level to the rnaximum level ot 
saturation, smax, is equal to a small percentage ol the 
total number of pixels in the image. For example, a suit- 
able percentage could be approximately 0.5% ol the to- 
tal number of pixels. Saturation components in the 
range of amin to wpper are linearly mapped to the en- 
tire dynamic range of saturation values [SMIN, SMAX] 
available in the video processing system. In this manner, 
small perturbations in the saturation values of pixels are 
ignored without compromising the integrity of the en- 
hanced image. 

[0027] Using the first and second transformation func- 
tions, the intensity and saturation values of the original 



image are modified. T^e hue components ot the Image 
are not changed, and remain the same from the original 
image to the enhanced image. The inlensity values, as 
welt as the color saturation values, of the anginal image 
5 have been enhanced to the maximum extent practicable 
for use in the operational environment of en arbitrarily- 
selected video processing system. The ^sult is an op- 
timally enhanced color image without the introduction of 

color distortion. 
iq [0028] lnsomesystemapplications.itmaynotbefea- 

sible to determine the available dynamic range of the 
video processing system which will be used to perform 
image enhancement For example, the dynamic range 
specifications of the video processing system may be 
is unknown, or it may be desirable to perform image en- 
hancement using any of a plurality of ^M^eeM 
video processing systems, eacn ol which has ditferen 
characteristics. In such applications, a different set of 
first and second transformation functions could be em- 
£0 pioysd for each video processing system, wherein each 
set of transformation functions is optimized for a specific 
video processing system. Alternatively, one set of arbi- 
trarily-determined transformation functions may be em- 
ployed, wherein the functions are selected to provide 
55 usoful transformations for a wide variety of video 
processing systems, even though the functions are not 
fully optimized for use with any one system. 
[0029] The techniques described in the preceding 
paragraphs with reference to the first and second trans- 
30 formation functions may be appl ted to a color space oth- 
er tnan HSV( although such an application will not nec- 
essarily yield optimum results. The process of convert- 
ing other color spaces into the HSV domain isoften com- 
putationally intensive, placing excessive demands on 
35 system hardware. For some system applications, such 
as video telephones which communicate using NTSC 
video signals, the required computations would man- 
date the use of undesirably expensive hardware. 
[0030] The process of converting a non-HSV color 
40 space into the HSV domain introduces other problems 
in addition to computational complexities. Certain colors 
in one color space may not be physically realizable in 
another color space. For example, some colors m the 
YCDCr color space of conventional NTSC video signals 
45 may convert into negative values of color in RGB color 
space. Such negative values are not physically realiza- 
ble. 

[0031] in view of the foregoing difficulties involved in 
converting a non-HSV color space into the HSV domain, 
so a method is disclosed for enhancing a color image di- 
rectly in conventional NTSC YCbGr color space. This 
method operates in real time and is applicable to any 
video dovice which captures color images in an NTSC 
format. 

sb [0O32] Th e luminance (Y) component of a convention- 
al NTSC signal is enhanced following the procedures 
described above in connection with the intensity com- 
ponent of the HSV color image. Then, if the chromi- 
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nance components Cb and Cr are mod*.* by th ^ame 
amount *sthe luminance (V) component. ?*° r J?"* 
Son will remain the same as In the original r^The 
S that the color saturation will remain the sarnecan 
bTverifled through mathematical derivations known to 
frose sKlied in the art and disclosed In a textbook ent, 

Foley atal., published by Addison-Wesley * 1991. How- 
ever, in order to optimally enhance a color Image tt» 
satumtioncc^ponentsofthelmag*^ 
ified to improve the overall saturation * *. hjagj. 
100331 The saturation components of the NTSC im- 
age are enhanced by modifying the chrominance com- 
ponents. Cb and Cr, by a greater amount *an the 
amountby which the luminance component. Y. has been 
enhanced. In other words, the slope ol the transform* 
tion tunction applied to the chrominance «^P on * n * 
(the chrominance transformation function) should be 
greater than the slope of the transformation function ap- 
plied to the luminance component (the luminance trans- 
fer function). In cases where the luminance component 
Is modified to a relatively large extent by the luminance 
transformation tunction, this is an indication that the 
original image is relatively unsaturated. The modifica- 
tion performed by the luminance transformation function 
is inversely proportional to the amount of saturation in 
the original imago. Therefore, in cases where the satu- 
ration is relatively low. the saturation should be in- 
creased proportionally, with reference to circumstances 
where the saturation is relatively high. 
[0034] One technique lor measuring the amount by 
which saturation should be increased is by computing 
the deviation from linearity of the luminance transforma- 
tion function. With reference to FIG. 1. the y axis which 
represented 'intensity output" Is now conceptualized as 
representing luminance output levels, and the x axis is 
now conceptualized as representing luminance input 
levels For each of a plurality of luminance levels, the 
absolute difference between the piece wise linear map- 
ping function 102 and an Identity mapping function 103 
is calculated. The absolute differences for an of the lu- 
minance levels are then summed up to obtain the total 
deviation from linearity, denoted by Dev. Then, the fol- 
lowing equation is employed to calculate thB value of 
Incr. Incr is used to determine the amount by which the 
chrominance components should be increased: 1.0 < 
(Incr- Dev/8000) £ 2,0. The value of 8000 In the de- 
nominator is a representative value set forth for purpos- 
es of illustration. Other numerical values may be em- 
ployed in the denominator in place of 8000 such as. for 
example, 7000. which also provides useful perform- 
ance. 

[0035] Refer now to FIG. B. which is a graphical rep- 
resentation of a transformation function for mapping the 
Cr chroma component of a color Image, and also to FIG. 
7, which is a graphical representation of a transforma- 
tion function for mapping the Cb chroma component of 
a color image. The slope of the piacewise linear map- 



ping function 102 (FlGs. 6 and 7) for the range (vtot~r. 
v JUd (FIG. 1) is multiplied by ftwwto obta.n the slope 
oTSelhrominance transfer function. 
mum and maximum levelsof chrominance m t^ 0 ™"™ 
. 5a are mapped to the entire ' «£?5 
«Jdynamic range (FIGs. 6 and 7). A white , portlOS 
correspondingtoa chrominance level of 128 fw«**Cr 

(FIG 6) and Cb (FIG. 7) is mapped to itself by the 
d,rominancetran B fertur^ion.U S in9tti e lurrtn a nceand 

io chrominance transfer functions. »Ha luminance and 
chrominance components values of the original mage 
are transformed to create an optimally enhanced Image 
dree* in YCbCr color space. YCbCr color space may 
be employed in the context of conventional PAL. se- 
ts CAM. and/or NTSC video signals. 

[00361 Another preferred embodiment disclosed 
hereif ! enhances gray-level textual and/ordocument im- 
ages by decreasing the blurring of the image and by in- 
creasing the contrast between light and dark regions of 
20 the image. These gray-level images may be represent- 
ed, tor example, in NTSC YCbCr color space. A major 
objective of text image enhancement is to increase the 
readability of text. Since readability of a text image .s 
determined by the luminance component of the image. 
as this method focuses on enhancing the luminance (") 
component If the color information present in a Q*/on 
image is very limited, then the chrominance compo- 
nents Cb and Cr may not require any processing. Oth- 
erwise, Cb and Cr may be processed as desenbed in 
SO the immediately preceding paragraphs. 

[00371 Detection of the amount ol color information in 
an image Is performed by determining the amount of his- 
togram spread of the Cb and Cr components. If the his- 
togram spread is smaller than a given threshold, I.e.. 
as approximately 23. then 1he lext image is treated as a 
gray-level image and only the luminance component is 
enhanced. 

[0038] One possible approach tor textual image en- 
hancement is to stretch the Y histogram to the maximum 
40 available dynamic range, thereby enhancing image con- 
trast. Although this approach improves the image, fur- 
ther improvements are possible. Pursuant to the method 
disclosed herein, the background gray level of the text 
imago is determined. Textual images generally contain 
45 a relatively limited number ol discrete gray levels, as is 
the case tor binary documents. black text on white back- 
ground, etc. The background gray level corresponds to 
a significant peak in the Y (luminance) histogram. Such 
a luminance histogram is similar to the intensity value 
so histogram, except that pixel luminance values are 
graphed in lieu ol pixel Intensity values. The peak in the 
Y (luminance) histogram ie detected by checking the 
gray level at which the peak detection signal crossos 
over zero from negative values to positive values. Tho 
ss peak detection signal is generated by computing the dif- 
ference between the cumulative histogram and a 
smoothed version of the cumulative histogram, the de- 
gree of smoothing determining the sensitivity of the peak 
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?3 For purposes of the present -«P^Jhj« 
Lak in the Y histogram which represents the back- 
oSundgray leve.must be detected. This detect™ proc- 
e^i dependent upon whether the origin* decuman 

a low gray level background. For high gray eve back- 
grounds, starting from the maximurr .gray '^ein the 
histogram, the first peak encountered in the his ogram 
5SJ ? background gray level. For low gray leve ^back- 
grounds, starting from the minimum gray level mthe his- 
togram, the first peak encountered in the histogram is 
the background gray level. _ . Q 

T00401 Assume, for purposes of the present example 
[hat the textual image has a high gray level background 
denoted as ybkg. As stated above, an alternative tor 
tocating the background gray level is » "Jf 
the first peak from the high gray level end of the Y his- 
togram. However, the Y histogram should be smoothed 
first (using conventional smoothing procedures), other- 
wise the searching process will locate a peak in a local 
areahavinga relatively small perturbation, while entirely 
missing the larger peak representing the actual back- 
ground gray level. 

[0041] The minimum foreground value of the docu- 
ment, denoted as ymin, can be located by examining 
the Y histogram from its lower gray level end. During the 
search, the first few minimum values corresponding to 
a small percentage of total number of pixels are ignored. 
This small percentage may be in the vicinity of 0.1%. as 
an illustrative example, thereby allowing the method to 
skip relatively small perturbations in the observed gray 
levels of the textual image. 

[0042] The contrast of the textual image is enhanced 
by mapping the Y (luminance) component from [ymin, 
ybkg) to [YMIN, YMAX] . where YMIN and YMAX are. 
respectively, the minimum and maximum Y values of the 
video processing system. Before mapping the Y values, 
a technique generally known to those skilled m the art 
as unsharp masking is applied to the Y components of 
the entire image to remove any blurring from the textual 
image. Conventionally, this sharpening operation caus- 
es the appearance olhalos around the text edges, which 
is not very pleasing to human eyes. Since these halos 
are caused by overshoots in pixel values above the 
background gray level, ybkg. the halos can be easily 
removed using standard methods known to those skilled 
in the an after mapping the Y values from [ymin. ybkg] 
to [YMIN. YMAXJ. Note that the mapping function should 
be determined before the unsharp masking is applied to 
the image; otherwise, the background level cannot be 
detected correctly and the halos can no longer be re- 
moved. 

[0043] Due to the fact that the textual image enhance- 
ment method described herein takes into consideration 
the characteristics of the actual textual image, the meth- 
od effectively removes blurring from the image and max- 
imizes contrast. In addition, if the original and the en- 



hanced Images are both compressed in a format known 
S .»£ in the art aa JPEG, ^ few block- 
ing artifacts will appear in the enhanced image. Fewer 
blocking artifacts appear because the enhanced .mage 
s Sdes a more uniform background and more untonn 
foreground gray levels. Although the textual image en- 
hancement method was described in the context of 
YCbCrcolor space.the method is also applicable tooth.- 

er color spaces. , 
io 5)044] FIG. 4 is a pictorial representation showing the 
application of the color Image enhancement Procedures 
disclosed herein to an illustrative color image Jr. order 
to demonstrate the effectiveness ol the methods dis- 
closed herein, an illustrative image ^00 was manually 
15 degraded to provide a test Image 402. Illustrative Image 
400 and test image 402 are in YCbCr color 3P^ ,ret 
enhanced image 404 Is the enhanced image which re- 
sults when a transfer function Is applied only to the Y 
component of the test image 402. As was predated 
eo above, the color of ihe enhanced image 404 is not en- 
hanced relative to the tBSt image 402. 
[0045] Second enhanced image 406 is the image 
which results when transfer functions are applied to the 
luminance and chrominance components of the test im- 
tts age 402 Color distortion, caused by interactions be- 
tween the various color components, is clearly ob- 
served, Some type of color compensation scheme must 
be used to account for interactions between the various 
color components, and to remove such color distortion. 
so [0046] Third enhanced image 40S is the image wh.ch 
results when any of a number of commereially-ava , abl e 
image processing software packages are utilized. 
These software packages generally includes some type 
of color compensation scheme which accounts lor inter- 
as actions between the various color components. Even 
though the color is not distorted, these prior art software 
packages do not provide an optimally enhanced image. 
[0047] The test image 402 may be optimally en- 
hanced by using the methods disclosed herein, as de- 
40 soribed above in connection with FIQs. 1 -3. Such an op- 
timally enhanced image 41 0 is shown in FIG. 4. By com- 
paring each of the enhanced images 404. 40S. 408, 41 0 
with the illustrative image 400, it is observed that the 
methods disclosed herein enhance contrast and color 
45 saturation to the maximum extent practicable. Moreo- 
ver, the methods disclosed herein do not provide color 
distortion. 

[00481 F ' Q - 5 ia a P'ctorial representation showing me 
application of the gray-scale image enhancement pro- 
so cedures disclosed herein to an illustrative optically- 
scanned document. Textual image 500 Is a portion of an 
original textual image obtained from an AT&T Picasso 
Still imago Phone. The AT&T Picasso Still Image Phone 
is disclosed in copending U.S. Patent application Serial 
as Number oa/202608. Enhanced image S02 was pre- 
pared using a Y histogram stretching process as de- 
scribed above, followed by unsharp masking. It is ob- 
served that the contrast is not optimized, and that halos 
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have been introduced by the masking P««£j=£ 
nanced image 504 was prepared ^^^J 
function described above and generated from the de 
tected background gray level Note that some bturrtng 
b present Enhanced image 506 was prepared ueingthe 
methods disclosed herein. It is observed that the cor, 
trast of the imago has been optimized, and the blurnng 
has been removed. 



to 
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so 
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Claims 

1 A method of enhancing a color image using a video 
processing system equipped to represent a dynam- 
ic range of intensity values and a dynamic rang* of 
saturation values, the method comprising the fol- 
lowing steps: 

representing the color image by a plurality ol 
pixels in HSV (hue. saturation, and intensity) 
color space, the color image having a finite 
range of intensity values and a finite range of 
saturation values; 

applying a first transformation function to the fi- 
nite range of intensity values and a second 
transformation function to the finite range of 
saturation values; the first transformation func- 
tion transforming the first finite range of inten- 
sity values to correspond to the entire dynamic 
range of intensity values; the second transfor- 
mation function transforming the finite range of 
satu ration values to correspond to the entire dy- 
namic range of saturation values; 
the first and second transformation functions 
thereby providing an enhanced image having 
fully optimized intensity and saturation values. 

2. A method of enhancing a color image as set forth 
in Claim 1 wherein the first transformation function 
is a piece wise linear mapping function in two di- 
mensions having three substantially linear regions 
defined by four intensity value points; the first di- 
mension representing the finite range of intensity 
values, and the second dimension representing the 
dynamic range of intensity values, 

the method further comprising the steps of: 
denning a First intensity value point as being 
represented by the minimum intensity value in 
the Image; 

defining a second intensity value point as being 
represented by the maximum intensity value in 
the image; 

and selecting third and fourth intensity value 
points having values in the first dimension be- 
tween the first and second Intensity value 
points. 



30 



3$ 



40 



45 



SO 



A method ol enhancing a color image as set fonh 
in Claim 2 wherein the piece wise linear mapping 
function consists of first, second, and third line seg- 
ments, the first line segment being defined by points 
vmln and vtower, the second line segment being 
defined by points vtowerand vupper t and the third 
line segment being defined by points vupper and 
vmsx such that vmin is the minimum intensity val- 
ue in the image, vmax is the maximum intensity val- 
ue in the image; 

the method further comprising the step of; 
selecting Wowerand vupper based upon the 
relative overexposure or underexposure of the im- 
age such that: 

if the image is relatively under-exposed, viewer 
is selected to be relatively close to vmin and 
vuppert selected to be relatively distant from 
vmaXt thereby compressing high intensity val- 
ues and expanding low intensity levals; and 
if the image is relatively over-exposed, vupper 
is selected to be relatively close to vmax and 
rfower is selected to be relatively distant from 
vmln, thereby compressing lower intensity val- 
ues and expanding higher intensity values. 

X. A method of enhancing a color image as set forth 
in Claim 3 wherein vupper and Woirerare calcu- 
lated by performing the steps of: 

developing an intensity value histogram for the 
image to be enhanced by dividing the range 
from vmin and vmax into a plurality of sub- 
ranges such that, for each of the plurality of 
sub-ranges, the number of pixels in the image 
having intensity values in this sub-range is cal- 
culated; the center of gravity of the intensity val- 
ue histogram being defined as the first moment 
and being indicative as to the relative over- or 
under-exposure of the image, such that the first 
moment is relatively closer to vmto than to 
vmexior an underexposed image and relative- 
ly closer to vmax than to vmin for an overex- 
posed image; and 

selecting vfowerand vupper such that, as the 
first moment becomes Increasingly closer to 
vmln f vupper increases and viewer decreas- 
es, and. as me first moment becomes increas- 
ingly closer to vmax, vupper decreases and 
viewer increases. 

5. A method of enhancing a color image as set forth 
in Claim 4 wherein vupperarri Wtowerarc calcu- 
lated by performing the steps of: 

defining ihe full dynamic range of intensity val- 
ues of the video processing system as [VMIN, 
VMAX], wherein VMIN corresponds substan- 
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tiaily to the minimum intensity value capable or 
being represented in the video processing sys- 
tem, and VMAX corresponds substantially to 
the maximum intensity value capable of being 
represented in the video processing system; 
linearly mapping intensity values in the range 
ot vm/n and vloworm the first dimension to in- 
tensity values in the range of VMIN and VLOW- 
ER in the second dimension, where VLOWER 
- VMIN 4- {(vtower - vminyrn), where m is a 
real number In the approximate range of 2 lo 4; 
linearly mapping Intensity values in the range 
of vfowarand vupper in the first dimension to 
intensity values in the range of VLOWER and 
VUPPER in the second dimension, where 
VUPPER = VMAX- Uvmax- vupper)/Kl where 
k is a real number in the approximate range of 
2 to 4; and 

linearly mapping intensity values in the range 
of vupper and vmax in the first dimension lo 
the intensity values in the range of VUPPER 
and VMAX in the second dimension. 

6, A method of enhancing a color image as sat forth 
in Claim 5 wherein the video processing system 
consists of a video display device and VMIN and 
VMAX are selected to correspond to the minimum 
and maximum intensity values capable of being dis- 
played on the video display device. 

7, A method of enhancing a color image as set fortn 
in Claim 5 wherein a second transformation function 
is used to transform the saturation components of 
the original image into saturation components for 
the enhanced image. 

8, A method of enhancing a color image as set forth 
in Claim 7 wherein the second transformation func- 
tion is determined by applying a histogram stretch- 
ing procedure to a saturation histogram represent- 
ing the saturation components of the color image. 

9, A method of enhancing a color image as set forth 
in Claim 8 wherein the histogram stretching proce- 
dure includes the steps of selecting a first satu ration 
value point, smtn, representing the minimum satu- 
ration value in the Image, and a second saturation 
value point, smax, representing the maximum sai- 
u ration value in the image. 

10, A method of enhancing a color Image as set forth 
in Claim 9 wherein an upper limit of saturation, sup- 
per, is defined as that saturation level where the ar- 
ea under the saturation histogram from that level to 
the maximum level of saturation. xmax, is equal to 
a small percentage of the total number of pixels in 
the image. 



11. A method of enhancing a color image as set forth 
in Claim 10 wherein the small percentage is approx- 
imately equal to 0.5% of Ihe total number of pixels 
in the image. 

5 

12. A method of enhancing a color image as set forth 
in Claim 10 wherein saturation components in the 
range of smin to supper are linearly mapped to the 
entire dynamic range ol saturation values [SMIN. 

10 SMAX] available In the video processing system, 
whereby small perturbations In the saturation val- 
ues of pixels are ignored without compromising the 
integrity ot the enhanced image. 

19 13. A method ol enhancing a color image as set forth 
in Claim 10 wherein the Intensity values of the im- 
age are modified using the first transformation func- 
tion to provide enhanced image Intensity values, 
and the saturation values of the image are modified 

20 using the second transformation function to provide 
enhanced image saturation values. 

14. A method of enhancing a color image as set forth 
in Claim 1 3 wherein the hue components of the im- 
2S ago to be enhanced constitute the hue components 
of the enhanced image. 



PcrtentansprOche 



30 



1. Verfahren zum Verbessem eines Farbbildes unter 
Verwendung eines Vldeobearbeitungssystems, 
das dazu ausgestattet ist, einen dynamischen Be- 
reich von Intensitatswerten und einen dynamischen 
3S Bereich von Sattigungswerten darzustellen, wobel 
das Verfahren die folgenden Schritte urnfaBt 

Darstellung des Farbbildes durch eine vielzahl 
von Pixein im HSV-Farbraum (Farblon, Satti- 
40 gung und Intensitat), wobei das Farbbild einen 

endlichen Bereich von intensitatswerten und 
einen endlichen Bereich von Sattigungswerten 
hat; 

Anwendung einer ersten Transformationstunk- 
45 Hon auf den endlichen Bereich von Intensitats* 

warten und einer zweiten Transformationslunk- 
tion auf den endlichen Bereich von Sattigungs- 
werten, wobei die ersie TransformaUonsfunkli- 
on den ersten endlichen Bereich von Intensi- 
so tatswerten transformiert, dam it er dem gesanv 

ten dynamischen Bereich von Intenshatswer- 
tsn entspricht. und wobei die 2weite Transfor- 
mationsfunktion den endiichon Bereich von 
Sattigungswerten transformiert, damit er dem 
be . gesamten dynamischen Bereich won Satti- 

gungswerten entspricht; 
wodurch die ersten und zweiten Transformati- 
on sfunktlon en einverbessertes Bild lief em, das 
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voll optimierte Intensitats- undSattigungswerte 
hat. 

2. Verlahren zum Verbessem eines Farbbildes nach 
Anspruch 1 , worin die srste Transformationsfunkti- 5 
on eine stQcKwelse lineare Darstellungsfunktion in 
zwei Dimenslonen mlt ctrai im wesentlichen linea- 
ren, durch vier Intensitatswertpunkte definierten 
Gebieten ist, wobei die erste Dimension den endli- 
chen Bereich von intensitatswerten darstellt und die 10 
zweit© Dimension den dynamischen Bereich von In- 
tensitatswerten darstellt, 

wobei das Verfahren weiterhin die Schritte 
airfweist: 

is 

einen ersten Intensitats we rtpunkt 2u detinie- 
ren, wie er durch den Minimalintensitatswert im 
Bild dargestellt wird; 

dinen zweiten intensitatswertpunkt zu definie- 
ren, wie er durch den Maximal inlensitalswerL so 
im Bild dargestellt wird; 
und drrtte und vierte Intensitatswertpunkte aus- 
zuwahien, die Werte in der ersten Dimension 
zwischen den ersten und zweiten Intensitats' 
wertpunkten haben. 2$ 

3. Verfahren zum Verbessem eines Farbbildes nach 
Anspruch 2, worin die stQckweise lineare Darstel- 
lungsfunktion aus ersten, zweiten und dritten tini- 
ensegmenten besteht, wobei das erste Uniensag- 30 
ment durch die Punkte vmin und Wowerdefiniert ist. 
das zweite Uniensegment durch die Punkte vfower 
und vupper definiert ist und das drrtte Unienseg- 
ment durch die Punkte vupper und vmax definiert 

ist, so daft wrrinder Mininatintensitatswert im Bild, as 
vmax der Maximalintensttatswert im BHd ist: 

wobei das Verfahren weiterhin den Schritt 
umfaGt: 

v/Owar und vupper, basierend auf der relatrven *o 
Qberbelichtung Oder Unterbetichtung des Bil- 
des, auszuwahlen, so daB: 
wenn das BUd relativ unterbelichtet 1st, vlower 
so gewahlt wird, daG es relativ nana an vmin 
liegt und vupper go gewahlt wird, daft es relativ *s 
entfemt von wraax liegt, wodurch hohe Intensi- 
tatswene komprimiert und niedrige Intensiiats- 
niveaus gedehnt werden, und, 
wenn das Bild relativ uberbelichtet ist, vupper 
so gewahlt wird, daft es relativ nahe an vmax &° 
liegt, und viewer $o gewahlt wird, daft es rofativ 
entfemt von vmin liegt, wodurch niedrige re ln- 
tensitatsworte komprimiert und hdhcre Intense 
tStswerte gedehnt werden. 

ss 

4. Verlahren zum Verbessem eines Farbbildes nach 
Anspruch 3, worin vupperand vtowardurch Ausfflh- 
rung der fotgenden Schritte berechnet werden; 



Entwicklung eines Intensttatswerthistogramms 
fur das zu verbessemde Bild durch Teilung des 
Bereichs von vmin und vmax in eine Vtelrahl 
von Unterbereichen, so da& fur ieden aus der 
Vielzahl der Unterbereichedie Anzahl der Pixel 
im Biid. die Intensitatswerte in diesem Unterbe- 
reich haben, berechnet wird, wobei der 
Schwerpunkt des intensitatswerthistogramms 
als das erste Moment definiert wird und indika- 
tiv bezuglich der relativen Dber- Oder Unterbe- 
lichtung des Bildes ist, so daft das erste Mo- 
ment fOr ein unterbelichtetes Bild relativ naher 
zu um/nalszu vmaxundfurein uberboiichtetes 
Bild relativ naher zu vmax als zu vmin ist; und 
Auswahl von vtoworunti vupper, sodaG, wah- 
. rand das erste Moment sich zunehmend vmin 
nahert, vupper zunimmt und viower abnimrnt, 
und, wan rend das ersto Moment sich 2unoh- 
mend vmax nahert, vupper abnimrnt und vlo- 
wsr^unimmt. 

5. Verfahren zum Verbessem eines Farbbildes nach 
Anspruch 4, worin vupper und Waiver durch Ausf On- 
rung der folgenden Schritte berechnet werden; 

Definierung des voilen dynamischen I n ten si- 
tatswertbereichs des Videobsarbejtungssy- 
stems als [VMIN, VMAX]. wobei VMIN im we- 
sentlichen dam Minimalintansitatswsrt ent- 
spricht, der im Videobearbeitungssystem dar- 
gestellt werden kann, und VMAX im wesentli- 
chen dem Maximafintensitatswert entspricht. 
der im Videobearbeitungssystem dargestellt 
werden kann; 

lineare Zuordnung von Intensititswerten im 
Bereich von vmin und vlower \n der ersten Di- 
mension zu Intensitatswerten im Bereich von 
VMIN und VLOWER In der zweiten Dimension, 
wo VLOWER - VMIN + {(vlower- vminVm], wo 
m eine reells Zahl im Naherungsbereich von 2 
bis 4 ist; 

lineare Zuordnung von Intensitatswerten im 
Bereich von viewer und vupper in der ersten Di* 
mension zu Intensitatswerten im Bereich von 
VLOWER und VUPPER in der zweiten Dimen- 
sion, wo VUPPER = VMAX - [(vmax - vupper)/ 
k}, wo k eine reelie Zahl im Naherungsbereich 
von 2 bis 4 ist; und 

lineare Zuordnung von Intensltatswerten im 
Bereich von vupper und vmax \r\ der ersten Di- 
mension zu Intensttatswsrten im Bereich von 
VUPPER und VMAX in der zweiten Dimension. 

& Verfahren zum Verbessem eines Farbbildes nach 
Anspruch 5, worin das Videobearbeitungssystem 
aus einem VideobiJdschirrngerat besteht und VMIN 
und VMAX gewahlt werden, urn den Minimal* und 
Maximal int ens itatswert en zu entsprechan, die auf 



Received from < 858 655 5859 > at 1011/03 2:31 :00 PM [Eastern Daylight Time] 



10 



OCT-01-2003 12:25 HP SAN DIEGO LEGAL 858 655 5859 P. 47/65 



19 



EP 0 723 364 B1 



20 



dem Videobildschtrmgerat dargestellt warden kon- 
nea 

7. Verlahren zum Verbessern eines Farbbildes nach 
Anspruch 5, worin eine zweite Transformations- 
tunktlon verwendet wird, um die Sattigungskompo- 
nenten des Originalbildes in Sattigungskomponen- 
ten fur das verbesserte Bltd zu translormieren. 

8. Verlahren zum Verbessern eines Farbbildes nach 
Anapruch 7, worin die zweite Transformetionsfunk- 
tion bestimmt ist durch die Anwendung eines Histo- 
grammstreckungsverfahrens auf ein Sattigungs- 
hietogramm. das die Sattigungskomponenten des 
Farbbildes darstellt. 

9. vertahren zum Verbessern eines Farbbildes nach 
Anspruch 8, worin das Histogrammstreckungsver- 
fahrens die Schritte einschlleftt. einen ©rsten Satti- 
gungswerlpunkl, sm/a auszuwahlen, der den Mini- 
malsattigungswert Im Bild darstetlt, und elnen zwei- 
ten Sattigungswertpunkt, smax, der den Maximal- 
sittigungswert im Bild darstellt. 

10. Verfahren 2um Verbessern oinofi Farbbildes nach 
Anspmch 9, worin eine Sattigungsobergrenze, sup- 
per, ale dasjenige Sattigungsniveau definiert ist, wo 
dar Bereich unter dem Sattigungshistogramm von 
jenem Niveau zum Maximalsattigungsniveau. 
smax, gleich ein em gerlngen Prozentsat* dar Ge- 
samtpixelzahl im Bild ist. 

11. Verlahren zum Verbessern eines Farbbildes nach 
Anspruch 10, worin der garinge Prozentsatz unge- 
tahr gleich 0,5 % der Gesarntpbtelzahl im Bild ist. 

12. Verlahren zum Verbessern eines Farbbildes nach 
Anspruch 10, worin Sattigungskomponenten im Be- 
reich von sm/nbis supper linear dem gesamten dy- 
namischen im Videobearbeitungssystem vertGgba- 
ren Bereich von Sattrgungswerten [SMIN, SMAX] 
2ugeordnet warden, wodurch kleine Storungen in 
den Sattigungswerten von Pixeln ignoriert warden, 
ohnedie Unversehrtheildesveroesserten Bildes zu 
gefahrden. 

13. Verlahren zum Verbessern eines Farbbildes nach 
Anspruch 10, worin die Intensftatswerte des Bildes 
unter Verwendung der ersten Transfoi mationsiunk- 
tion modifiziert werden, um verbesserle Bildintensi- 
tatswerte zu lietern. und die Sattigungswerte des 
Bildes unter Verwendung der zweiten Transforms* 
tfonsfunklion modifiziert werdon, um vcrbossert© 
Bildsattigungswsrte zu liefem. 

14. Vertahren zum Verbessern eines Farbbildes nach 
Anspruch 13. worin die Farbtonkomponenten des 
zu verbessemden Bildes die Farbtonkomponenten 



des verbessarten Bildes bilden. 



Revindications 

5 

1. Precede ^amelioration d'une image en couleurs 
utilisant un systeme de traitement video equips 
pour representor une gamme dynamique de va- 
leurs d'intensite et une gamme dynamique de va- 
io leurs de saturation, 1e precede comprenant les eta- 
pes suivantes : 



la representation do I'image en couleurs par 
une pluralite de pixels dans I'aspace des cou- 
leurs TSV (teinte, saturation, et intensite). Time- 
ge en couleurs ayant une gamme finie de va- 
leurs d'intensite et une gamme ftnie de vaJeurs 
de saturation ; 

('application cTuns fonction de transtormation a. 
la gamme finis de valeurs d'intensite et d'une 
seconde fonction de transformation a la gam- 
me finie de valeurs de saturation ; la premiere 
fonction de transtormation transformant la pre- 
miere gamme finie de valeurs d'intensite afin 
qu'elle corresponds a la totalite de la gamme 
dynamique de valeurs d'intensite ; la seconds 
lonction de transformation transformant la 
gamme finie de valeurs de saturation afin qu'el- 
le corresponds a la totalite de ta gamme dyna- 
mique de valeurs de saturation ; 
tes premiere et seconde fonctions de transfor- 
mation fournissant ainsi une image amelioree 
ayant des valeurs d'intensite et de saturation 
entierement optimisees. 
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2. Precede d'amelioration d'une image en couleurs 
suivant la revendication 1, dans lequel ta premiere 
fonction de transformation est une fonction de pro- 
jection lineaire par morceaux a deux dimensions 
40 ayant trois regions sensiblement lineaires definies 
parquatre points de valeurs d'intensite ; la premiere 
dimension represemant la gamme finie de valeurs 
d'intensite, et la seconde dimension representant la 
gamme dynamique de valeurs d'intensite, 

45 

la precede comprenant en outre lea e tapes de : 
definition d'un premier point de valeur d'inten- 
site comma etant represents par la valeur d'in- 
tensite minimale dans I'image ; 

*0 definition d'un second point de valeur d'intensi- 

te comma etant represent© par la valeur d'in- 
tensite maxtmale dans Mmage ; 
et selection dc troisicmc ct quatrieme points de 
valeurs d'intensite ayant dee valeurs dana la 

ss premiere dimension, comprises entre les pre- 

mier et second points de valeurs dlntensitd. 

& Precede d'amelioration d'une image en couleurs 



Received from < 858 655 5859 > at 1011/03 2:31 :00 PM [Eastern Daylight Time] 



OCT-01-2003 12:26 HP SAN DIEGO LEGAL 858 655 5859 P. 48/65 



21 



EP 0 723 364 B1 



22 



is 



suivant la revocation 2. dans (equal ^ tonct.on 
de projection lineaire par morceaux 
depremier.secondettrois^^ 
le premier segment de droits etant defini i par das 
points vmin et Wr* le second segment de drotte 
etant defini par des points vini et vsup, et le troi- 
sieme segment do droit* etant defini par des points 
rcwet vmax detelle facon que vm/n sort la valeur 
cf inteneite minimale dans rimage, et que vmaxsoit 
la valeur d'intensite maxlmale dans rimage ; 

le precede comprenant en outre les Stapes de : 
selection de Wrrfet de vsup siir la base d'une 
supposition ou dTune sous-exposition relative 
de r image de telle facon que ; 
si rimage est relativement sous-exposee. virtf 
sort sSlectionne de facon h etre relativement 
proche de vmin et vsup soit selectionne de fa- 
con & etre relativement eloign^ de vmax, afin 
de comprimer afrisl les valeurs d'intensite ele- *> 
vees et de dilater les nh/eaux d'intensite 
fables ; et que 

si rimage est relativement surexposSe, vsup 
soit selectionnS de facon & etre relativement 
prooho de vmax et vfatsaM selection^ de ta- *s 
con a etre relativement eloigne de vmin, afin 
de comprimer atnsi tea valeurs d'intensite plus 
faiblss et de dilater les valeurs d'intensite plus 
elevees. 

30 

4. Precede cfarr^lioration d'une image en couleurs 
suivant la revendication 3. dans lequel vsup ex vinf 
sont calcules par execution des ©tapes de : 

elaboration d'un histogramme de valeurs d'in- 55 
tensite pour rimage devant etre amelior6e en 
divisant la gam me ailant de vmin a vmax en 
une pluralite de sous-gammes. de telle facon 
que, pour chacune de la pluralite de sou3-gam- 
mes, le nornbre de pixels dans rimage ayant 
des valeurs d'intensite so situ ant dans cette 
sous-gamme soit calcule ; le centre de gravite 
de I'histogramme de valeurs d'intensite etant 
defini comma etant le premier moment et com- 
me $tant representatit de la surexposition ou 
de la sous-exp09rtion relative de rimage, de la- 
con que le premier moment soit relativement 
plus proche de vmin que de vmax pour une 
image sous-exposde et relativement plus pro- 
che de vmax que de vmin pour une image so 
surexposee ; et 

selection de vin/et de vsup de telle lacon que, 
lorsque le premier moment se rapproche de 
vmin, vsup croisse et vM decroisse* et que 
Eor&que le premi«r moment fie rapproche de ss 
vmax, vsup decroisse et v/nYcroisse- 

S. Precede d'amelioration d' une Image en couleurs 



suivant la revendication 4. dans lequel vsupet vinf 
sont calcules par execution des etapes de : 

definition de la gamme dynamique totals de va- 
leurs d'intensite du systeme de traitement vi- 
deo comme etant [VMIN, VMAXl ou VMIN cor- 
respond sensiblement a la valeur d'intensite 
minimale pouvant etre representee dans le sys- 
tems de traitement video, et VMAX correspond 
sensiblement a la valeur d'intensite maximal© 
pouvant etre representee dans le systeme de 
traitement video ; 

projection lineaire de valeurs d'intensite dans 
la gamme de vm/rt & vM dans la premiere di- 
mension, en valeurs d'intensite se situant dans 
ta gamme de VMIN a VINF, dans la seconde 
. dimension, ou VINF = VMiN + {(Wnf - vm/n)/ 
m}, m atant un nornbre reel dans la gamme ap- 
proximative de 2 a 4 ; 

projection lineaire de valeurs d'iniensite dans 
la gamme de Wrrfa vsup. dans la premiere di- 
mension, en valeurs d'intensite dans la gamme 
de VINF a VSUP, dans ta seconde dimension, 
ou VSUP = VMAX • {(vmax- vaup)/k)) t k etant 
un nornbre reel dans la gamme approximative 
de2a4;et 

projection lineaire de valaurs d'intensite dans 
la gamme de v$up & vmax, dans la premiere 
dimension, en valeurs d'intensite se situant 
dans la gamme de VSUP a VMAX dans la se- 
conde dimension. 

6. Precede ^amelioration cfune image en couleurs 
suivant la revendication 5, dans lequel le systeme 
de traitement vidSo est constitue d'un dispositrf d'af - 
fichage video et VMIN et VMAX sont selectionnes 
de facon & corresponds a des valeurs d'intensite 
minimale et maximale pouvant etre affichees sur le 
cfispositif d'affichage video. 

7. Proc6de d'amelioration d'une image en couleurs 
suivant la revendication 5. dans lequel une seconde 
tonction de transformation est utilisee pour trans- 
former les composames de saturation de 1'image 
origlnale en des composantes de saturation desti- 
nees a ('Image ameltoree. 

8. Proc^de d'amelioration d'une image en couleurs 
suivant la revendication 7, dans lequel la seconde 
tonction de transformation est determines en appli- 
quant une procedure d'etalement de I'histograrnme 
en un histogramme de saturation representam les 
composantes de saturation de i'image en couleurs. 

9. Procodd d'amelioration d*unc Image en couleurs 
suivant la revendication 8, dans lequel la procedure 
d'eMalement de rhtstogramme comprand les etapes 
de selection c?un premier point de valeur de satu- 
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ration «n*. repentant la valeur * «J£ 
minimal* dans I'image, et d'un second 
leU r saturation <^ax represented la valeur de 
saturation maximal dans i'image. s 

10 Procede d»amelioratlon d'une image en c <*'° u £ 
uTant la revendication 9. dans lequel une tim.te 
supeZ* do saturation »sup est ^"TJ 
tort la nrveau do saturation M Que * wrttoa 
sous rhistogramme de saturation, de ce niveau au 
niveau maximal de saturation smax sort egale a^ un 
petit percentage du nombre total de ptxete dans 
i'image. 

11. Procede d'amelioration d'une image en c^uleurs 
suivant la revendicatlon 10, dans lequel » P«M 
pourcentage est approximatiyement egal a o,s *> 
du nombre total de pixels dans rtmage. 

12 Procede <f amelioration d'une image on couleurs 
• suivant la revendication 10, dans lequel dee com- 
posantes de saturation se situant dans la gamme 
de smin a ssup sent projetees ItaSairement sur la 
totalis de la gamme dynamique dea valeurs de sa- 
turation [SMIN. SMAX] pouvant etre obtenues dans 
la systeme de traitement video, de sorts que de f ai- 
bles perturbations de* valeurs de saturation de 
pixels sort ignorees sans oompromenre I'mtegrite 
de r image amelioree. ^ 

13. Procede amelioration d'une image en couleurs 
suivant la revendication i0> dans lequel les valeurs 
d-intensite de I'image sont modifiees en utihsant la 
premiere fonction de transformation pour produire 
des valeurs d'intensite d'image amelioree, et les va- 
leurs de saturation de I'image sont modifiees en uti- 
lisant la seconde fonction de transformation pour 
obtenir des valeurs de saturation d'image amelio- 
rees. 

' 14. Procede d'amelioration d'une image en couleurs 
survant la revendication 13, dans lequel les compo- 
santes de teinte de I'image devant etre amelioree 
constituent les composantes de teinte de l*image 
amelioree. 
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